Neuroelectric Virtual Devices 


Kevin Wheeler, Computational Sciences Division, NASA Ames Research Center 
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This paper presents recent results in neuroelectric pattern recognition of 
electromyographic (EMG) signals used to control virtual computer input devices. The devices 
are designed to substitute for the functions of both a traditional joystick and keyboard entry 
method. We demonstrate recognition accuracy through neuroelectric control of a 757 class 
simulation aircraft landing at San Francisco International Airport using a virtual joystick as 
shown in Figure 1. This is accomplished by a pilot closing his fist in empty air and performing 
control movements that are captured by a dry electrode array on the arm which are then analyzed 
and routed through a flight director permitting full pilot outer loop control of the simulation. We 
then demonstrate finer grain motor pattern recognition through a virtual keyboard by having a 
typist tap his fingers on a typical desk in a touch typist position. The EMG signals are then 
translated to keyboard presses and displayed. The paper describes the bioelectric pattern 
recognition methodology common to both examples. Figure 2 depicts raw EMG data from 
typing the numeral ‘8’ and the numeral ‘9’. These two gestures are very close in appearance and 
statistical properties yet are distinguishable by our hidden Markov model algorithms. Extensions 
of this work to NASA missions and robotic control are considered. 
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